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(54) Method and system for inputting gestures 

(57) The present invention relates to a system, 
method and medium for receiving and acting upon user 
input. In one embodiment, the user may only have ac- 



cess to a limited input device, like a stylus. Using the 
present invention, a user is provided with intuitive re- 
sponses from the system based on inputs from the lim- 
ited input device. 
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Description 

Cross-Reference to Related Applications 

[0001] The present application is based on U.S. pro- 
visional patent application no. 60/247,400, filed Novem- 
ber 10, 2000, entitled "Highlevel Active Pen Matrix". 
[0002] The present application is also related to ap- 
plication Serial No. (Atty docket 3797.00066), entitled 
"Method and Apparatus For Improving the Appearance 
of Digitally Represented Handwriting", filed November 
10, 2000; to application Serial No. (Atty docket 
3797.00069) $ entitled "Selection Handles in Editing 
Electronic Documents", and filed November 10, 2000; 
to application Serial No. (Atty docket 3797.00070), en- 
titled "Insertion Point Bungee Space Tool", and filed No- 
vember 10, 2000; to application Serial No. (Atty docket 
3797.00072), entitled "Simulating Gestures of a Mouse 
Using a Stylus and Providing Feedback Thereto", and 
filed November 10, 2000; to application Serial No. (Atty 
docket 3797.00074), entitled "System and Method For 
Accepting Disparate Types Of User Input", and filed No- 
vember 10, 2000; to application Serial No. (Atty docket 
3797.00075), entitled "in Air Gestures", and filed con- 
currently with the present application; to application Se- 
rial No. (Atty docket 3797.00076), entitled "Mouse Input 
Panel Windows Class List", and filed November 10, 
2000; to application Serial No. (Atty docket 
3797.00077), entitled "Mouse Input Panel and User In- 
terface", and filed November 10, 2000; and to applica- 
tion Serial No. (Atty docket 3797.00079), entitled "Sys- 
tem and Method For Inserting Implicit Page Breaks", 
and filed November 10, 2000; each of which is incorpo- 
rated by reference herein. 

Field of the Invention 

[0003] Aspects of the present invention are directed 
generally to apparatus and methods for controlling a 
graphical user interface (GUI). More particularly, the 
present invention relates to receiving user input, deter- 
mining based on the user input what the user wants to 
do, and performing a function related to the desired in- 
put. 

Background of the Invention 

[0004] Typical computer systems, especially compu- 
ter systems using graphical user interface (GUI) sys- 
tems such as Microsoft WINDOWS, are optimized for 
accepting user input from one or more discrete input de- 
vices such as a keyboard and for entering text, and a 
pointing device such as a mouse with one or more but- 
tons for driving the user interface. Virtually ail software 
applications designed to run on Microsoft WINDOWS 
are optimized to accept user input in the same manner. 
For instance, many applications make extensive use of 
the right mouse button (a "right click") to display context- 



sensitive command menus. The user may generate oth- 
er gestures using the mouse such as by clicking the left 
button of the mouse (a "left click"), or by clicking the left 
or right button of the mouse and moving the mouse while 
5 the button is depressed (either a "left click drag" or a 
"right click drag"). 

[0005] in some environments, a mouse is not usable 
or desirable. For example, in a digitizer tablet environ- 
ment, the primary input device may be a stylus. While a 

10 stylus attempts to provide pad and paper-like feel to a 
computing environment, current systems are limited. 
For example, the use of a stylus in a graphical user in- 
terface is limited to tapping on various items for selec- 
tion. See, for example, the Palm-series of products us- 

15 ing the Palm OS 3.0 operating system. Further, in stylus- 
based input environments, a user is continually forced 
to select tools or operations from a remote tool bar, gen- 
erally on a top or bottom of a screen. While a user can 
type in letters or have the digitizer recognize handwrit- 

20 jng, these operations require selecting a keyboard input 
mode and writing in a predefined portion of the digitizer, 
respectively. In short, requiring a user to tell the compu- 
ter, for every new input, what a user wants to do makes 
stylus-based computing difficult for the average user. 

25 Accordingly, stylus based inputs have been relegated to 
personal data assistants (PDAs) where significant user 
input is not possible. Mainstream computing still re- 
quires the use of at least a keyboard and mouse (or 
mouse-based input device, for example, trackballs, 

30 touch-pads, and other mouse substitutes). 

[0006] Accordingly, a need exists for permitting a user 
to perform all operations of a mouse-type device using 
a stylus. 

35 Summary of the Invention 

[0007] As discussed in the various copending patent 
applications incorporated herein by reference, aspects 
of the present invention are directed to a tablet-like com- 

40 puterthat allows users to directly write on a display sur- 
face using a stylus. The display surface may physically, 
optically, and or electro magnetically detect the stylus. 
The computer may allow the user to write and to edit, 
manipulate, and create objects through the use of the 

45 stylus. Many of the features discussed in these copend- 
ing applications are more easily performed by use of the 
various aspects of the present invention discussed 
herein. 

[0008] An aspect of the present invention is directed 
50 to methods and apparatus for simulating gestures of a 
mouse by use of a stylus on a display surface. The 
present invention determines the operation a user wants 
to perform based on the user's input. This determination 
may include reference to other information including the 
55 location of the user's input on a digitizer (e.g., location 
on a screen) and the status of other objects or elements 
as displayed. By using this information, the system de- 
termines what the user wants to do and implements the 
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action. 

[0009] A number of inputs with a stylus are possible. 
For example, a user may tap a stylus, stroke the stylus, 
hold the stylus at a given point, or hold then drag the 
stylus. Other inputs and combinations are possible as s 
noted by the above-identified applications, which are ex- 
pressly incorporated herein by reference. 
[001 0] As to a stroke operation, the system may drag 
an object, may maintain a current state or operation, or 
being inking. Inking may include writing, drawing, or 10 
adding annotations as described in greater detail in U. 
S. Serial No. 60/212,825, filed June 21, 2000, entitled 
"Methods for Classifying, Anchoring, and Transforming 
Ink Annotations" and incorporated by reference. 
[0011] As to a tap operation, the system may add to 1$ 
existing writing, may select a new object, insert a cursor 
or insertion point, or may perform an action on a select- 
ed object. 

[0012] As to a hold operation, the system may simu- 
late a right mouse button click or other definable event. 20 
[0013] As to a hold and drag operation, the system 
may drag a selected object or perform other functions. 
[0014] These and other features of the invention will 
be apparent upon consideration of the following detailed 
description of preferred embodiments. Although the in- 25 
vention has been defined using the appended claims, 
these claims are exemplary in that the invention is in- 
tended to include the elements and steps described 
herein in any combination or subcombination. Accord- 
ingly, there are any number of alternative combinations 30 
for defining the invention, which incorporate one or more 
elements from the specification, including the descrip- 
tion, claims, and drawings, in various combinations or 
subcombinations. It will be apparent to those skilled in 
the relevant technology, in light of the present specif ica- 35 
tion, that alternate combinations of aspects of the inven- 
tion, either alone or in combination with one or more el- 
ements or steps defined herein, may be utilized as mod- 
ifications or alterations of the invention or as part of the 
invention. It is intended that the written description of 40 
the invention contained herein covers all such modifica- 
tions and alterations. 

Brief Description of the Drawings 

45 

[0015] The foregoing summary of the invention, as 
well as the following detailed description of preferred 
embodiments, is better understood when read in con- 
junction with the accompanying drawings, which are in- 
cluded by way of example, and not by way of limitation so 
with regard to the claimed invention. In the accompany- 
ing drawings, elements are labeled with three-digit ref- 
erence numbers, wherein the first digit of a reference 
number indicates the drawing number in which the ele- 
ment is first illustrated. The same reference number in 55 
different drawings refers to the same element. 
[0016] Figure 1 is a schematic diagram of a general- 
purpose digital computing environment that can be used 



to implement various aspects of the invention. 
[001 7] Figure 2 is a plan view of a tablet computer and 
stylus that can be used in accordance with various as- 
pects of the present invention. 

[001 8] Figures 3-7 are flowcharts showing a variety of 
steps for interpreting a user's input in accordance with 
embodiments of the present invention. 

Detailed Description of Preferred Embodiments 

[0019] The present invention may be more readily de- 
scribed with reference to Figures 1-7. Figure 1 illustrates 
a schematic diagram of a conventional general-purpose 
digital computing environment that can be used to im- 
plement various aspects of the present invention. In Fig- 
ure 1 , a computer 1 00 includes a processing unit 1 1 0, a 
system memory 1 20, and a system bus 1 30 that couples 
various system components including the system mem- 
ory to the processing unit 1 1 0. The system bus 1 30 may 
be any of several types of bus structures including a 
memory bus or memory controller, a peripheral bus, and 
a local bus using any of a variety of bus architectures. 
The system memory 120 includes read only memory 
(ROM) 140 and random access memory (RAM) 150. 
[0020] A basic input/output system 1 60 (BIOS), con- 
taining the basic routines that help to transfer informa- 
tion between elements within the computer 100 : such 
as during start-up, is stored in the ROM 140. The com- 
puter 1 00 also includes a hard disk drive 1 70 for reading 
from and writing to a hard disk (not shown), a magnetic 
disk drive 1 80 for reading from or writing to a removable 
magnetic disk 190, and an optical disk drive 191 for 
reading from or writing to a removable optical disk 192 
such as a CD ROM or other optical media. The hard disk 
drive 1 70, magnetic disk drive 1 80, and optical disk drive 
1 91 are connected to the system bus 1 30 by a hard disk 
drive interface 1 92, a magnetic disk drive interface 1 93, 
and an optical disk drive interface 1 94, respectively. The 
drives and their associated computer-readable media 
provide nonvolatile storage of computer readable in- 
structions, data structures, program modules and other 
data for the personal computer 1 00. It will be appreciat- 
ed by those skilled in the art that other types of computer 
readable media that can store data that is accessible by 
a computer, such as magnetic cassettes, flash memory 
cards, digital video disks, Bernoulli cartridges, random 
access memories (RAMs), read only memories (ROMs), 
and the like, may also be used in the example operating 
environment. 

[0021] A number of program modules can be stored 
on the hard disk drive 170, magnetic disk 190, optical 
disk 192, ROM 140 or RAM 150, including an operating 
system 1 95, one or more application programs 1 96, oth- 
er program modules 197, and program data 198. A user 
can enter commands and information into the computer 
1 00 through input devices such as a keyboard 101 and 
pointing device 102. Other input devices (not shown) 
may include a microphone, joystick, game pad, satellite 
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dish, scanner or the like. These and other Input devices 
are often connected to the processing unit 110 through 
a serial port interface 1 06 that is coupled to the system 
bus, but may be connected by other interfaces, such as 
a parallel port, game port or a universal serial bus (USB). 
Further still, these devices may be coupled directly to 
the system bus 130 via an appropriate interface (not 
shown). A monitor 1 07 or other type of display device is 
also connected to the system bus 130 via an interface, 
such as a video adapter 108. In addition to the monitor, 
personal computers typically include other peripheral 
output devices (not shown), such as speakers and print- 
ers. In a preferred embodiment, a pen digitizer 165 and 
accompanying pen or stylus 1 66 are provided in order 
to digitally capture freehand input. Although a direct con- 
nection between the pen digitizer 165 and the process- 
ing unit 110 is shown, in practice, the pen digitizer 165 
may be coupled to the processing unit 110 via a serial 
port, parallel port or other interface and the system bus 
130 as known in the art. Furthermore, although the dig- 
itizer 1 65 is shown apart from the monitor 1 07, it is pre- 
ferred that the usable input area of the digitizer 165 be 
co-extensive with the display area of the monitor 107. 
Further still, the digitizer 165 may be integrated in the 
monitor 1 07, or may exist as a separate device overlay- 
ing or otherwise appended to the monitor 1 07. 
[0022] The computer 1 00 can operate in a networked 
environment using logical connections to one or more 
remote computers, such as a remote computer 1 09. The 
remote computer 109 can be a server, a router, a net- 
work PC, a peer device or other common network node, 
and typically includes many or all of the elements de- 
scribed above relative to the computer 100, although on- 
ly a memory storage device 111 has been illustrated in 
Figure 1 . The logical connections depicted in Figure 1 
include a local area network (LAN) 112 and a wide area 
network (WAN) 1 1 3. Such networking environments are 
commonplace in offices, enterprise-wide computer net- 
works, intranets and the Internet. 
[0023] When used in a LAN networking environment, 
the computer 1 00 is connected to the local network 112 
through a network interface or adapter 114. When used 
in a WAN networking environment, the personal com- 
puter 100 typically includes a modem 115 or other 
means for establishing a communications over the wide 
area network 113, such as the Internet. The modem 115, 
which may be internal or external, is connected to the 
system bus 130 via the serial port interface 106. In a 
networked environment, program modules depicted rel- 
ative to the personal computer 1 00, or portions thereof, 
may be stored in the remote memory storage device. 
[0024] It will be appreciated that the network connec- 
tions shown are exemplary and other techniques for es- 
tablishing a communications link between the comput- 
ers can be used. The existence of any of various well- 
known protocols such as TCP/IP, Ethernet, FTP, HTTP 
and the like is presumed, and the system can be oper- 
ated in a client-server configuration to permit a user to 



retrieve web pages from a web-based server. Any of var- 
ious conventional web browsers can be used to display 
and manipulate data on web pages. 
[0025] Figure 2 illustrates a tablet PC 201 that can be 
5 used in accordance with various aspects of the present 
invention. Any or all of the features, subsystems, and 
functions in the system of Figurel can be included in the 
computer of Figure 2. Tablet PC 201 includes a large 
display surface 202, e.g., a digitizing fiat panel display, 
10 preferably, a liquid crystal display (LCD) screen, on 
which a plurality of windows 203 is displayed. Using sty- 
lus 204, a user can select, highlight, and write on the 
digitizing display area. Examples of suitable digitizing 
display panels include electromagnetic pen digitizers, 
15 such as the Mutoh or Wacom pen digitizers. Other types 
of pen digitizers, e.g., optical digitizers, may also be 
used. Tablet PC 201 interprets marks made using stylus 
204 in order to manipulate data, enter text, and execute 
conventional computer application tasks such as 
20 spreadsheets, word processing programs, and the like. 
[0026] A stylus could be equipped with buttons or oth- 
er features to augment its selection capabilities. In one 
embodiment, a stylus could be implemented as a "pen- 
cil" or "pen", in which one end constitutes a writing por- 
25 tion and the other end constitutes an "eraser" end, and 
which, when moved across the display, indicates por- 
tions of the display are to be erased. Other types of input 
devices, such as a mouse, trackball, or the like could be 
used. Additionally, a user's own finger could be used for 
30 selecting or indicating portions of the displayed image 
on a touch-sensitive or proximity-sensitive display. Con- 
sequently, the term "user input device", as used herein, 
is intended to have a broad definition and encompasses 
many variations on well-known input devices. 
35 [0027] Region 205 shows a feed back region or con- 
tact region permitting the user to determine where the 
stylus as contacted the digitizer. In another embodi- 
ment, the region 205 provides visual feedback when the 
hold status of the present invention has been reached. 
40 [0028] Figures 3-7 show various flowcharts for deter- 
mining what a user wants to do based on a user's inter- 
action with the digitizer. As will be discussed below, the 
user contacts the digitizer where the user wants to begin 
writing, tapping, annotating, dragging, etc. In the case 
45 where the digitizer is superimposed over a display, the 
user's contact with the digitizer is directed at operating 
at (or near) the contact point between the user's stylus 
and the currently displayed information at or near the 
contact point. 

so [0029] In step 301 , the system senses a contact or 
other indication of an action. In one embodiment the 
contact may be the stylus contacting the surface of the 
digitizer. In another embodiment, the action may be 
bringing the tip of the stylus near the digitizer's surface. 

55 Further, if the stylus includes another signaling method 
(for example, a radio transmitter transmitting a signal to 
the digitizer signaling a user's input), the digitizer (or re- 
lated input mechanism or mechanisms) interpret the re- 
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ceived signal as a user's input. Other methods of start- 
ing an operation or writing or contact with a digitizer are 
known in the art. For purposes of illustration and de- 
scription, the system and method reference physical 
contact with the digitizer. All other ways of providing sig- 
nals to a processor are considered within the scope of 
the invention and are not mentioned here for simplicity. 
[0030] In step 302, the system determines the contact 
position and what lies beneath the contact position (for 
example, an object, a drawing, blank space, ink : and the 
like). In step 303, the system determines if the stylus 
has moved beyond a first threshold (time, distance, rate, 
or acceleration, and the like), fn one embodiment, the 
threshold is set to the minimum resolvable movement. 
In another embodiment, the threshold is set higher to 
account for shaky hands, vibrations of the digitizer or 
tablet pc (for example, if trying to use the system while 
driving in a car over a bumpy road). It is noted that ob- 
jects may have all the same threshold. Alternatively, ob- 
jects may have different thresholds. This may be de- 
pendent on the object, the size of the object, the state 
of the system, the state of the object, and the like. 
[0031] If the first threshold has been exceeded, then 
the system proceeds to step 304 where the user's input 
is classified as a stroke and the system steps to point A 

305. If the first threshold has not been exceeded, the 
system determines if the stylus was still in contact with 
the digitizer when a time threshold had expired in step 

306. If no (meaning that the stylus was still in contact 
with the digitizer surface), the system classifies the input 
as a tap in step 307 and proceeds to point B 308. 
[0032] tf the stylus was still in contact with the surface 
after the time threshold in step 306, the system deter- 
mines if a second move threshold was exceeded in step 
309. The first and second move thresholds may be iden- 
tical or different. For example, both may be .25 mm. Or, 
the first may be .5 mm or one mm and the second be . 
3 mm. Further, the first may be 1 .2 mm or more and the 
second may be .5mm or more. In short, any values may 
be used as long as they are not obtrusive to the user. 
The second threshold may be determined only after the 
time threshold of step 306 has expired. In this example, 
the second threshold may be higherthan the first thresh- 
old (or it may be the same or smaller). 

[0033] If the second move threshold was not exceed- 
ed, then the system classifies the input as a hold in step 
310 and proceeds to point C 311. If the second move 
threshold was exceeded, then the system classifies the 
input as a 'hold and drag' in step 312 and moves to point 
D313. 

[0034] Figure 4 shows point A as starting point 401 . 
Here, the system classified the input as a stroke and 
begins stroke processing in step 402. In step 403, the 
system determines if the stroke started on a draggable 
object. If yes, the system determines in step 404 wheth- 
er drag threshold was exceeded (for example, .25 
inches, .25 inches per second and the like), tf so, the 
system classifies the stroke as a drag in step 405 and 



performs a function that is dependent on the object. For 
example, the drag may extend a selection as described 
in greater detail in "Selection Handles in Editing Elec- 
tronic Documents," filed concurrently with the present 
5 application (attorney docket 03797.00069), and ex- 
pressly incorporated by reference. Also, the drag may 
operate a bungee tool as described in Serial No. (Atty 
docket 3797.00070), entitled "Insertion Point Bungee 
Space Tool", and filed concurrently with the present ap- 
10 plication, and expressly incorporated herein. 

[0035] If, in step 404, the drag threshold has not been 
exceeded, the system maintains the current state (with 
the object being selected or not) in step 407. If the stroke 
was not over a draggable object in step 403, the system 

15 determines if the area under the contact point is inkable 
in step 408. For example, inkable may mean an area 
capable of receiving ink (including drawings : annota- 
tions, or writing) as detailed in serial no. 60/212,825, 
filed June 21 , 2000, and expressly incorporated herein 

20 by reference for essential subject matter. By contrast, a 
control button (for copy, save, open, etc.) may not be 
inkable. If inkable in step 408, the system permits inking 
(drawing, writing, annotating and other related func- 
tions) in step 409. If not inkable, the system maintains 

25 the current state (objects selected or not) in step 407. 
[0036] In Figure 5A, the system starts at point B 501 
and operates on the input as a tap 502. The system de- 
termines whether the tap was on an area or object that 
is inkable in step 503. If yes, the system determines 

30 whether any ink was recently added or "wet" (for exam- 
ple, less than .5 or 1 second old) in step 504. If so, the 
system considers the tap as a dot to be added to the ink 
in step 505 (and adds the dot). If no wet ink exists, then 
the system determines if the tap was over a selectable 

35 object in step 506. It is noted that steps 503 and 504 
may be combined. If the tap was over a selectable ob- 
ject, then the system determines if the object was al- 
ready selected in step 507. If it was not, then the system 
selects the tapped object in step 508. If a previous object 

40 had been selected, the system cancels the previous or 
old selection in step 509. If the object was previously 
selected as determined by step 507, the system per- 
forms an action relevant to the object in step 510. This 
action may include editing the object, performing a pre- 

45 defined operation (for example, enlarge, shrink and the 
like). From step 506, if the tap was not on a selectable 
object, then the system proceeds to point BB 512. 
[0037] Figure 5B shows additional processing to Fig- 
ure 5A. As point BB 512, the system determines if the 

so tap was in a space between text (referred to herein as 
an inline space) in step 513. If yes, the system places 
an insertion point at the tap point in step 514. As shown 
in a broken lined box, the system may also cancel any 
old or previous selections in step 515. If no, then the 

55 system determines if the tap point has ink nearby in step 
'518. If the system determines that the tap was nearby 
ink, then the system adds a dot to the ink in step 51 6. If 
there was an old selection, then the system cancels the 
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old selection in step 517 (as shown by a broken line 
box). 

[0038] If not nearby ink in step 518, the system deter- 
mines if the tap is on an active object in step 51 9. If the 
tap was not on an active object, the system places an 
insertion point at the tap point or performs some other 
definable action in step 520. Again, if there was an old 
selection, then the system cancels the old selection in 
step 521 (as shown by a broken line box). If the tap was 
on an active object as determined by step 51 9, the sys- 
tem performs an action in step 522. The action may be 
definable by the user or relate to any function desirable. 
In one embodiment, the action may be to perform afunc- 
tion to operate a selection handle or bungee space tool 
as described in "Selection Handles in Editing Electronic 
Documents," filed concurrently with the present applica- 
tion (attorney docket 03797.00069), and expressly in- 
corporated by reference. Also, the drag may operate a 
bungee tool as described in Serial No. (Atty docket 
3797.00070) : entitled "Insertion Point Bungee Space 
Tool", and filed concurrently with the present applica- 
tion, and expressly incorporated herein. Other opera- 
tions are known in the art and incorporated herein. 
[0039] Figure 6 relates to holding a stylus beyond a 
time threshold. Starting from point C 601 , the system 
classifies the user input as a hold operation in step 602. 
Next, the system simulates a right mouse button click 
or other definable event in step 603. The functions as- 
sociated with step 603 are described in greater detail in 
U.S. application Serial No. (Atty docket 3797.00072), 
entitled "Simulating Gestures of a Mouse Using a Stylus 
and Providing Feedback Thereto" : filed November 10, 
2000, whose contents are expressly incorporated here- 
in by reference. 

[0040] Figure 7 relates to holding a stylus beyond a 
time threshold and moving the stylus. Starting from point 
D 701 , the system classifies the user input as a hold and 
drag operation in step 702. Next, in step 703 the system 
drags the selected object as directed by the user. 
[0041] There are a number of alternatives associated 
with dragging. If the hold and drag relates to an inline 
space, the system may use this hold and drag function 
to select text. Similarly, one may use this function to se- 
lect a drawing encountered by the dragged stylus. Fur- 
ther, one may select both text and drawings in this man- 
ner. Also, the cursor's point may become a selection tool 
that leaves a trail behind it. In this regard, the user may 
loop a number of objects, drawing or text in this regard. 
The looping of the objects may result in the selecting of 
the objects. 

[0042] An alternate embodiment of the present inven- 
tion relates to modifying ink drawings or annotations. 
For example, if one added an annotation (from step 409) 
to text, one may manipulate the text (for example, by 
inserting new text) and have the annotation track the 
manipulation of the text. So, if one circled text then add- 
ed text to the circled text, the annotation would expand 
to include the added text as well. This is described in 



relation to in U.S. Serial No. 60/212,825, filed June 21 , 
2000, entitled "Methods for Classifying, Anchoring, and 
Transforming Ink Annotations" and incorporated by ref- 
erence. 

5 [0043] While exemplary systems and methods em- 
bodying the present invention are shown by way of ex- 
ample, it will be understood, of course, that the invention 
is not limited to these embodiments. Modifications may 
be made by those skilled in the art, particularly in light 

10 of the foregoing teachings. For example, each of the el- 
ements of the aforementioned embodiments may be uti- 
lized alone or in combination with elements of the other 
embodiments. 
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Claims 

1. A method for operating a digitizer comprising the 
steps of: 

20 

receiving user input; 

classifying the user input by using at least one 
of a time threshold and a movement threshold; 
and, 

25 performing an action based on the user input. 

2. A method of classifying a user's input to a computer 
comprising the steps of: 

30 receiving a user's input; 

classifying the user's input as one of a stroke, 
a tap, a hold, or a hold and drag based on at 
least one of the input satisfying a first move 
threshold, a time threshold, and a second move 

35 threshold. 

3. The method of classifying a user's input according 
to claim 2, wherein said classifying step is based on 
at least two of the input satisfying said first move 

^0 threshold, said time threshold, and said second 
move threshold. 

4. The method of classifying a user's input according 
to claim 2, wherein said classifying step is based on 

^5 the input satisfying said first move threshold, said 
time threshold, and said second move threshold. 

5. The method of classifying a user's input according 
to claim 2, wherein, if said input satisfies said first 

50 move threshold, the input is classified as a stroke. 

6. The method of classifying a user's input according 
to claim 2, wherein, if said input does not satisfy said 
first move threshold and said input does not satisfy 

55 said time threshold, the input is classified as a tap. 

7. The method of classifying a user's input according 
to claim 2, wherein, if said input does not satisfy said 
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time threshold and said input does not satisfy said 
second move threshold, said input is classified as 
a hold. 

8. The method of classifying a user's input according 
to claim 2, wherein, if said input does not satisfy said 
time threshold and said input satisfies said second 
move threshold, said input is classified as a hold 
and drag. 

9. A method of classifying a user's input to a computer 
comprising the steps of: 

receiving a user's input; 

classifying the user's input as one of a stroke, 
a tap, a hold, or a hold and drag based on at 
least one of the input satisfying a move thresh- 
old and a time threshold. 

10. A method of implementing a stroke input to a com- 
puter comprising the steps of: 

determining whether said stroke input started 
on a draggable object; 

determining whether said stroke input satisfies 
a drag threshold; 

in response to said first determining step and 
said second determining step, dragging said 
draggable object. 

11. A method of implementing a stroke input to a com- 
puter comprising the steps of: 

determining that said stroke input did not start 
on a draggable object; 

determining that location of said stroke input is 
inkable; and, 

adding ink to said location. 

12. The method according to claim 11, wherein said 
adding ink step includes at least one of drawing, 
writing, or annotating. 

13. A method of implementing a tap input to a computer 
comprising the steps of: 

determining at least one of whether a location 
of said tap includes wet ink, whether said loca- 
tion is in an inline space, whether said location 
includes a selectable object, and whether said 
object was previously selected; and 
performing at least one of adding a dot of ink, 
selecting said selectable object, placing an in- 
sertion point in said inline space, or performing 
an action associated with said object. 

14. The method of classifying a user's input according 
to claim 7, further comprising the step of: 



12 

simulating a right mouse click. 

15. The method of classifying a user's input according 
to claim 8, further comprising the step of: 

dragging a selected object. 

1 6. A computer-readable medium storing a program for 
operating a digitizer, said program comprising the 
steps of: 

receiving user input; 

classifying the user input by using at least one 
of a time threshold and a movement threshold; 
and, 

performing an action based on the user input. 

1 7. A computer-readable medium storing a program for 
classifying a user's input to a computer, said pro- 
gram comprising the steps of: 

receiving a user's input; 

classifying the user's input as one of a stroke, 

a tap, a hold, or a hold and drag based on at 

least one of the input satisfying a first move 

threshold, a time threshold, and a second move 

threshold. 

1 8. The computer-readable medium according to claim 
1 7, wherein said classifying step is based on at least 
two of the input satisfying said first move threshold, 
said time threshold, and said second move thresh- 
old. 

19. The computer-readable medium according to claim 
17, wherein said classifying step is based on the 
input satisfying said first move threshold, said time 
threshold, and said second move threshold. 

20. The computer-readable medium according to claim 
17, wherein, if said input satisfies said first move 
threshold, the input is classified as a stroke. 



21 . The computer-readable medium according to claim 
45 17, wherein, if said input does not satisfy said first 

move threshold and said input does not satisfy said 
time threshold, the input is classified as a tap. 

22. The computer-readable medium according to claim 
so 1 7, wherein, if said input does not satisfy said time 

threshold and said input does not satisfy said sec- 
ond move threshold, said input is classified as a 
hold. 

55 23. The computer-readable medium according to claim 
1 7, wherein, if said input does not satisfy said time 
threshold and said input satisfies said second move 
threshold, said input is classified as a hold and drag. 
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24. A computer-readable medium having a program for 
method of classifying a user's input to a computer 
comprising the steps of: 

receiving a user's input; 5 
classifying the user's input as one of a stroke, 
a tap, a hold, or a hold and drag based on at 
least one of the input satisfying a move thresh- 
old and a time threshold. 

10 

25. A system for acting on user input to a computer 
comprising: 

a stylus; 

a digitizer including a display; 15 
a processor; 

wherein said digitizer receives a user input via 
contact between said stylus and said digitizer and 
wherein said processor classifies the user input by 20 
using at least one of a time threshold and a move- 
ment threshold and wherein said processor per- 
forms an action based on the user input. 

26. The system according to claim 25, wherein said 25 
processor classifies said user input as one of a tap, 

a stroke, a hold, and a hold and tap. 

27. The system according to claim 25, wherein said ac- 
tion outputs information to said display. 30 
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